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ABSTRACT 

This 18-month phase of a continuing demonstration 
project was designed to develop and test a program of English 
literacy training for Puerto Rican workers. Participation in the 
Basic Occupational Language Training (BOLT) program was based on 
assumptions that an intensive exposure basis will result in 
significant improvement in job— related and non— job— related English 
language capability as measured by designated tests and followup, 
improvement in language capability will contribute significantly 
persistence, success in and benefit from specific job upgrading 
programs, as derived from analysis of skill training reports and 
followup in employment. Other than the positive results that language 
improvement does, in fact, occur, and that it contributes to job 
retention and upgrading, other inferences can be made from the data 
from computer analysis and a range of evaluation data compiled. The 
assumption that older men resist training is 
significant increases in language competency 
students. The report gives an account of technique 
resulted in a continuation of the experimentation i±i 
now in progress. (Author) 
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Purpose and Objectives 



A. The Need 

The Basic Occupational Language Training pilot 
demonstration program was developed to meet the English 
skill needs at job-entry and in job-upgrading for low- 
skill, low-wage Puerto Rican workers. 

The United States 1960 census, the Puerto Rican Forum's 
1964 Study of Poverty Conditions in the New York Puerto. 

Rican Community, the United States Department of Labor's 
yearly Report on Manpower Requirements , Resources, utilizat i on 
and Training and other research, proved that Puerto Ricans 
have the highest rate of unemployment and underemployment 
of an " identifiable ethnic group" with the exception of 
the American Indian, and that in the years following the 
1960 Census the situation had become increasingly worse. 

It was apparent that a major factor in the chronic and 
crippling job situation of the Puerto Rican was the 
inaccessibility of training because of his inability to 
speak and understand the English language. 

Many skill twining programs failed to produce results 
in the Puerto Rican community because, in addition to 
ignoring the basic need for a language training prere- 
quisite, they have been taught by individuals who lack 
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knowledge of the psychological and cultural make-up of 
the trainees. 

Blanket efforts in the field of manpower training 
without the benefit of the necessary experience in deal- 
ing with differential educational and work backgrounds, 
cultural biases towards authority, learning attitudes 
and the entire pattern of adjustment to life in New York 
City, are inevitably doomed to be counterproductive. 

in the case of Puerto Ricans and other Spanish- 
speaking workers, a lack of control of the English language 
makes it much more difficult or impossible for them to 
assimilate training that provides skills needed in the 
performance of certain job. The process of accumulating 
the vocabulary of the trade or profession is, depending 
on the complexity of the language involved in the perfor- 
mance of the job, an arduous, lengthy, and sometimes 
impossible task for the Puerto Rican worker to accomplish 

without guidance. 

A factor that compounds the language problems is 
that a lack of control of basic English is very often 
interpreted as a mark of inferior intelligence. This 
attitude makes it much more difficult or impossible for 
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the Puerto Rican worker to assimilate training that 
provides skills needed in the performance of certain 
duties. Moreover, employment which might adequately be 
performed with little or no knowledge of spoken English 
is often unattainable because of an inability to pass 
qualifying tests in English. It is important to note 
that Puerto Ricans are not being effectively reached 
by manpower training programs directed particularly at 
the group with which he identifies most, i« o., the low— 
skill, low-wage worker. In fact, no job upgrading 
program to date provides on— the— job training in job- 
oriented English geared to the needs of the Puerto Rican 
worker, except BOLT. 

The need for language training is more basic and 
reaching than would appear at first glance. Language 
is the most basic and probably the most important skill 
a worker must master. 

Language barriers impede far more than occupational 
inability. They also inhibit the educational progress 
of the young, social adjustment of immigrants, and such 
significant behavioral areas as consumer practices and 
management of personal finances. 
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B . Objectives of the BOLT Program 

The BOLT experiment and demonstration project was 
predicated upon the basic premise that the use of an 
eclectic, intensive exposure training system, with a major 
sub— system clearly and unmistakably work— related both in 
content and geographical proximity of training to the 
work situation, would create an effective learning situation. 
It would also utilize the motivational strengths arising 
out of a personal and cultural identification with and 
knowledge of the personality make-up of the individuals 
to be trained. Such an approach, it was felt, would have 
widespread heuristic value in combatting other intractable 
situations of underemployment and, indeed, unemployment. 
Successful results would suggest an added dimension of 
strength of job-related language training for other man- 
power development projects. 

The data amassed would also have applicability for 
the manpower training of all non-English— speaking groups 
and would contribute to the educational technology of the 
adult. 

The project objectives, stated as experimental hypothe- 
ses, were: 
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Hypothesis X 



Participation in BOLT training on an intensive exposure 
basis will result in significant improvement in gob-related 
and non- job-related English language capability as measured 
by designated tests. 

Hypothesis 2 

Improvement in language capability will contribute 
significantly to persistence, success in and benefit from 
specific job up-grading programs as derived from analysis 
of skill training session reports. This hypothesis must 
be considered and tested sequentially since it is dependent 
upon positive validation of hypothesis #1. 

Recruitment 

A. Projected Procedures 

The BOLT program, as it was originally projected, 

(Sept. 1, 1967 - Aug. 31, 1968) was to prepare workers to 

move into manpower training programs. In this respect, the 
liaison with Skill Advancement, Inc. (SAI) an OMPER project 
sponsored jointly by the Puerto Rican Forum, Inc., the 
Urban League and Cornell University School of Labor and 
Industrial Relations, was an integral part of the program. 
BOLT was to provide the language training as a prerequisite 
to the skill training of SAI. 
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B. Recruitment Procedures 

In actual practice, however, the anticipated BOLT— SAI 
relationship did not materialize. 

SAI referrals to BOLT were to have involved workers 
who, in the opinion of SAI, could profit from skill training 
once their ability to handle the English necessary for the 
training was develop'eci cr improved. These workers would 
be expected to acquire the English language skill in a 
BOLT course prior tc participation in an upgrading program. 
Those who demonstrated, as a result of tests administered 
upon completion of the corresponding BOLT course, an 
adequate knowledge of general English and job vocabulary 
would be invited to participate in SAI ‘ s upgrading program. 

SAI, however, did not live up to its agreement with 
the Puerto Rican Forum's Basic Occupational Language Training 
Program. A total of 39 Puerto Ricans out of 339 trainees, 
or 8.6% of all SAI trainees, were Puerto Ricans. They were 
all able to handle a skill program in English. Of a total 
of thirteen courses offered by BOLT only two, amounting to 
13 trainees in toto, were the outcome of a referral by SAI. 
This referral was one contact with the New York City 
Hospitals, the housekeeping division, which led to the 
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training of 13 men who had already completed an SAI 
training program. In no instance, therefore, did SAI 
feed into the BOLT program even one group of workers prior 
to SAI training. 

Consequently, if the BOLT program ad reliad upon SAI 
as the sole source for recruitment of tr^inises, che program 
would quickly have come to a standstill. bo rerrerrals 
from SAI were received after February, 196" : . 

This placed seemingly insurmountable dr> stages in the 
path of the BOLT program: the BOLT staff :iad tc determine 

possible occupational areas of interested employers and 
language handicapped workers, recruit such employers, pre- 
test and select all employees, assess the linguistic needs 
of various job situations and write all course materials. 
The limited staff of one director, one full-time instructor 
and one part-time instructor would have found the task 
impossible without the cooperation of the Puerto Rxcan 
Forum's Board of Directors who suggested contacts that made 
it possible for the BOLT program* to operate. The contract 
extension period. Sept. 1, 1968 - January 31, 1969 allowed 

for an additional staff member to carry on the sales - the 
Program De /eloper. 
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C. Criteria for Recruitment 

Based on the general objectives of the BOLT program, 
the following prerequisites were established for recruiting 
purposes. These were determined by two basic con iderations 
the need for a homogeneous group and the limitatio: of a 

maximum number of ten trainees per class. 

All trainees had to be Spanish-speaking. This requi- 
rement was dictated by the short duration and high intensity 
of the course of study. Since training was based on the 
intensive language training approach within a restricted 
period of hours, varied language backgrounds had to be 
precluded. Methodology of second language teaching is 
necessarily more effective and intensive when comparative 
phonological and morphological considerations are primary 
and attention can thus be focused on differences. 

The second prerequisite was that the trainee be 
literate in his first language — Spanish. In accordance 
with established knowledge about language learning, a 
person who is learning a second language should first know 
how to read and write his own. Moreover, modern audio- 
lingual methodology of learning a second language has 
demonstrated many parallels with the inital learning of 
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on -a 1 s native language. The kinds of processes involved 
can, therefore, he simulated in learning a second language, 
i. e., repetition, mimicry, grammatical analogy- The 
learner can build upon a strong knowledge of his own native 

language . 

Practical considerations were predetermined by the 
limited number of hours' that could be devoted to the 
program. This appeared to be the basic problem: how to 

use the given number of 50 hours in the most effective way;* 
The course was thus geared in such a way that the job- 
oriented language training took place in the classroom 
but was augmented by self-study. The actual contact 
hours were more than doubled in this way. Self-study 
was made possible through the use of programmed texts and 
these, necessarily, postulated literacy in Spanish in order 
to facilitate the completely individual, step-by-step, 
corrective learning . 

Recruitment of each course was limited to workers 
performing similar duties. Participants from the same 
job area made it possible for the BOLT staff to determine 
the specific occupational vocabulary and structures of 
the course content, thereby resulting in a more intensive 
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program of instruction. The same factor also insured 
a greater sense of fellowship within the group of workers 
and encouraged positive communication among them. 

t £ Recruitment Problems 

Employers expressed concern about the fact that a 

similar program was not being extended to other groups, 
eg. their Black employees. It was necessary to point 
out to them that the needs of the Puerto Rican workers 
are different and in fact, more pressing, expecially 
view of Puerto Rican unemployment figures. They felt 
that a BOLT course might be considered preferential treat- 
ment and would lead to alienation between groups. Employers 
had to be convinced that BOLT training would actually 
have a positive effect because it would allow Puerto 
Ricans to communicate with fellow-employees, staff and 
supervisory personnel in English. Every effort was made 
to encourage the non-Spanish-speaking personnel to help 
in the learning process. Others were included to the 
extent that they were counted upon for suggestions as to 
what the language needs were, formulation of vocabulary 
lists, creation of simulated work experiences, etc. 

There was also resistance on the part of employers 

to the idea that older men could learn. Test results 
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included in the evaluation section of this report 
demonstrate that such fears proved to be unwarranted. 

The lack of personnel made it impossible to mount 
a research campaign to determine where Spanish- speaking 
workers are employed in New York City, ie. geographical 
locale and specific type of industries. This would 
have greatly facilitated our recruiting efforts. BOLT 
also faced the competition of other kinds of programs in 
which employers or employees were compensated for parti- 
cipation in manpower training programs. BOLT had no 
such funds at its disposal and requested that employers 
release their workers from job duties for BOLT training. 

The fixed hours course (50 hours) was also a handicap, 
as it proved to be rigid and did not allow for legitimate 
employer or employee needs that could not meet it. A 
second phase of the proposal with new facilities and 
additional staff includes some control groups which will 
allow for greater flexibility in the scheduling of classes, 
These courses in approximately Phase I ran for 100 hours, 
on an experimental basis, for 13 weeks, 4 sessions per 
week. The data for one (BOLT XVIII) is included in the 
appendix (Montef iore Evaluation) . The other two courses 
(BOLT XX and XXI) were scheduled to terminate in Phase II. 
O 
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III. Staffing 

Recruitment and training of the BOLT staff was a 
significant aspect of the administration of the project. 

Qualifications for both trainers and consultants 
were carefully delineated, and candidates were interviewed 
and screened. 

The qualifications for trainers were that they be 
bilingual individuals with graduate training in the 
teaching of English as a second language and experience 
in teaching. In addition, they had to evidence commitment 
to the goals of the program and dynamic teaching ability. 
As a matter of more general policy, it was felt that 
traine s would be Puerto Ricans or people whose life 
experiences would enable them to empathize with and under- 
stand the trainees. Obviously, since the pool of indivi- 
duals with these qualifications is not large, it was 
necessary to do intensive recruitment in order to select 
the best qualified. BOLT staff limitations were severe 
until the contract extension allowed for more trainers, 
a Research and Curriculum Associate an Administrative 
Assistant. 
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Consultants were university faculty members with 
specialties in the areas of language training and research 
design shills. The consultants who were involved in 
the BOLT program are highly regarded members of their 
respective academic communicaties who have published 
and lectured extensively in their special fields. They 
also evidenced a commitment to the goals of the project 
and innovative approach to the task of upgrading through 
language skill training. The BOLT Advisory Committee 
performed an invaluable service to the BOLT program by 
suggesting avenues and procedures for program implemen- 
tation that were a result of pooled expertise in areas 
of linguistics, education, research, psychology and 
manpower training . 

IV. Course Scheduling 
A. Release Time 

The arrangements with employers for released time 
for a BOLT course posed significant problems. Although 
the initial period of release time requested was 50 hours 
(two hours per class, per day, for 5 weeks), the real 
figure generally granted was 25 hours. The course 
remained 50 hours long, but, of the great, majority of 
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cases, one hour of the worker's own time (lunch or prior 
to work day or beyond working day) complemented every 
hour granted by the employer. The requirement that the 
course meet every day also caused employers to balk; 
during the contract extension period this was reduced 
to 4 days per week. 

There were two programs (BOLT I and XVI) in which 
the workers contributed both hours for training and were 
not paid for this time. Program number I had to be 
cancelled and number XVI had an attrition of 10-7-5 
(only 5 workers graduated) , proving the difficulty 
prognosticated in attempting free time training. Four 
programs had total time contributed by the employer. 

These were offered to trainees engaged in all— day training 
programs and BOLT was included as part of the overall 
training offered. These were conducted in conjunction 
with the South Bronx Concentrated Employment Program 
(BOLT IV) and the Welfare Department's PREP project 
(BOLT VII) , The rest were scheduled on a one-to-one 
formula in which one hour was contributed by the employer 
and the other by the worker. The worker's hour usually 
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coincided with lunch or was scheduled at the end of the 
work day . 

The two hour block per training session proved to 
be adequate; it was not so short as to be unproductive or 
so long as to overextend the workers. Exposure to language 
training, moreover, is most beneficial when on a day to 
day basis as opposed to intermittent or widely spaced 
sessions of greater duration. Actual classes were extended 
to 6 1/2 weeks (meeting 4 days a week, ) during the contract 
extension period. 

A training cycle generally graduated on a Friday at 
the end of a five week period and a new one began on 
Monday. The new course followfed immediately on the heels 
of the prior one, thereby allowing only a week-end between 
the completion of one course and the start of a new one. 
Lengthy pre-testing procedures and the adaptation of the 
BOLT core curriculum to new training courses had to be 
carried on while other courses were being taught. Thxs 
proved to be an undue strain on staff, particularly in 
view of the fact that every course met every day. The 
contract modification permitted greater flexibilxty, 
generally extending the course from initial contact through 
first evaluation to 12 1/2 weeks. 
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B. Coordinate Courses 

The number (10) of trainees per course had a serious 
impact on the determination as to the type of employer 
contacted for recruiting. It was soon evident that small 
employers would claim that they could not afford to 
release ten employees without bringing production to a 
standstill. It was not practicable on the other hand, 
for BOLT to hand-tailor a curriculum and allot a teacher 
and course time for less than 9-10 workers. A very 
large employer with small individual locales can be 
encouraged to establish courses that recruit trainees 
with the same occupation from several sites. This was 
the case with the New York City Housing Authority: 44 
housing projects contributed 79 caretakers for 8 different 
courses who met in the Mobile Language classroom at 8 
locations, each one central to for the trainees involved. 
Schedules of this nature demand careful planning and 
coordination, but are well worth the effort. 

C. Mobile Language Classroom 

Qrxe large second hand school bus, especially equipped 
as a mobile language laboratory by White Electronics 
Corporation, was used as a classroom-on-wheels. The bus 
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had a sitting capacity of 12 (10 arm-chair-type desks, 

equipped with headsets for the trainees, a console-desk 
for the teacher with two tape desks, other visual aids, 
and a coded panel which permitted the teacher to commu- 
nicate with an individual member of the class or simul- 
taneously with the entire group, and one visitor's chair). 
The ceiling of the bus was acoustically treated. Students 
were able to record their own voices, and listen to the 
tape, teacher or record. The bus had to have heat and 
air-conditioning, which proved seriously inadequate, added 
to it as the training suffered during the winter and 
summer months because of the workers ' discomfort. 

Use of the Mobile Language Classroom was an invaluable 
asset; it eliminated carfare expenses for the workers and 
travel time. Parking the language laboratory - classroom 
in the very vicinity of the job also led to the involve- 
ment of the employer in the actual training, a factor 
which proved an added stimulus to its success. Lack of 
training facilities is a serious problem for most employers 
who proved anxious to have the services of the Mobile 
Language Classroom. 
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Inadequate city-wide sales promotion due to staff limi- 
tations hampered effective scheduling of courses within 
the same geographical area, a factor that would have 
reduced BUS travel time, gas expenses, and ultimately, 
breakdowns. The BOLT bus was old school bus converted 
to meet the specific needs of the program by White 
Electronics. Future bus facilities, however, should 
be originally designed to meet BOLT ' s special needs,, and 
not adapted. These plans are an integral part of BOLT, 
Phase II. Adaptations inevitably led to breakdowns 
which in turn, abstracted the progress of the training. 
Bus breakdowns, time off for repairs and allowances for 
transportation within congested city traffic interfered 
Witt tile scheduling Of training courses arid necessitated 
the hiring df a relief driver for the bus. 

V* Pre-testing 

A. The tests 

During the initial year of BOLT operation, 177 
subjects were pre-tested, interviewed and evaluated as 
part of the research activity of the project in order 
to determine 16 groups or 135 trainees. During all of 
phase I, 343 workers were pretested, 198 selected. 24 

24 
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dropped out, 174 graduated in the 21 courses. A complete 
analysis of the evaluation is in Section VIII, and a 
complete description of each of the exams below is in 

the ac company i ng materials . 

The principal evaluation of the project was through 
the analysis of possible gains in language ability as 

measured in four distinct ways: 

1. AURAL COMPREHENSION - The c ecity to hear and 
identify proper English langosge use as 
measured by the standardized Michigan English 
Aural Comprehension Test, 45 minutes, croup 
administered, by C. Fries err— S. Lado , 

2. STRUCTURE- The capacity to uss the appropriate 
structural form to conform 1 ' the grammatical 
rules of spoken English as measured by the 
standardized Michigan English Structure test, 

60 minutes, group administered, by C. Fries 
and R. Lado. 

3. JOB RELATED VOCABULARY - BOLT administered 
specially devised vocabulary tests with a 
sample of 10 words relating to the specific 
job situation in increasing difficulty. Since 
this test is presented visually and (if needed) 
aurally, the score earned by the trainee is not 
merely a yes or no rating, but an indication 

of working mastery of the specific vocabulary - 
10 minutes, individually administered - not 
during pre-testing, but in the first session 
of the course. 

4. INTERVIEW RATING - An individual interview was 
rated for general language use and fluency 
including factors of word choice, mostly of 
forms, pronunciation, enunciation, use of 
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appropriate tenses, etc. The standardized 
interviews were all tape recorded since 
their content involved responses to stimuli 
related to motivational variables elicited 
by projective pictures, and rated separately. 
The tape recordings were rated for language 
use in a conversational situation following 
Foreign Service Institute criteria with a 
rating scale from 0 - 5s 15 minutes, 
individually administered. 

As part of the research activity, information was collected 
as well on variables that were hypothesized as potentially 
relevant: to training success. These variables were demographic, 
descriptive, cognitive, motivational and affective. They 
include: 



(1) Birthplace - for most trainees, the birthplace also 
implied the first or primary language. 

(2) Length of residence in mainland United States 

(3) Age 

(4) Non verbal intelligence - The Raven Progressive 
Matrices (Form J) 1931 was administered. This test, 
which presents non-verbal or picture stimuli and calls 
for either a verbal or non-verbal response, has been 
used extensively throughout the world, as well as in 
Puerto Rico,, While there is considerable overlap 
between scores on this test and scores on verbal 
tests, the comparative ranking of our trainees does 
provide some valuable information on new cognitive 
capability, as distinct from that expressed in verbal 
terms. Non-verbal intelligence then is a control 
factor. 30 minutes group administered. 
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(5) Functional Socio - Economic Status 

For some of the subjects, the Environmental 
Participation Index (EPI) was filled out. This form 
represents a checklist of activities ancl objects 
that are ir solved an a functional utilization or 
cultural resources. It has been found to add a signi- 
ficant dimension of functionality to the delineation 
of socio-economic status. Airthough it is still e. per 
mental, the positive correlation between EPI scores 
and general intelligence scores also imply measure- 
ment of functional social capacity. (15 min., group 
administered) . 

(6) Motivational factors - All of the factors are measures 
through ratings given to tape recorded responses to 
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specially prepared drawings in the style of the 
Thematic Apperception Test (TAT) of Dr. Murray or 
Harvard University. 

The first picture.- for example, shows an adoles- 
cent standing near a table with one hand on a thick 
book, which resentolss a dictionary or text book. 

The subject is asked to tell a story describing what 
is going on, what led up tc it, how the person reels 
and what the outcome will be. Ratings of the responses 
have been made by the evaluation consultant and/or his 
associates . 

In case of any doubt or question about a parti- 
cular response, the rating given is the average of 
two or more rater's judgements. The four pre-training 
motivational variables included were ; 

(a) Attitudes toward education -(historic) with 
particular reference to experiences of adoles- 
cent years. 

(b) Attitudes toward authority - submissive, rebel 
lious, cooperative, etc. Is authority seen 

as helpful or threatening? 

(c) Orientation toward work - with particular re- 
ference to feelings about supervision, and 
outcomes of work. 

(d) Achievement Motive — adult oral readership 
activity, is it seen as good, effective, and 
helpful or not? 

B. Objectives and Administration of Pre Tests: 

The prime pbjective of the pre-tests was to arrive 
at a homogeneous group of ten trainees . Homogeneity was 
determined by three basic factors evaluated through the 
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testing: language background, literacy, and occupational 

background . Unif r .ani ty in language and occupation were 
essential to the x.r. .ensive., job-related language training 
of the BOLT glsrgrain. Spanish literacy was a prerequisite 
for the materials utilized. The first and third factors 
(language and crccuuational background) were determined 
by Che employer sna the third (literacy) by the BOLT 

staff. 

Every employer interested in a BOLT program re- 
ceived a set of bi -graphical data sheets in Spanish (In- 
forme Biografico), a copy of which is attached. The em- 
ployer was instructed to distribute the sheets to all 
interested workers, after initially explaining the BOLT 
program * 

Since the non-Spanish-speaking employer has no way of 
knowing whether the individual was literate in Spanish, 
this biographical report actually constitutes a literacy 
test in Spanish. The forms were distributed in the pre- 
sence of a supervisor and the applicants were asked to 
fill them otft individually. Approximately five minutes 
were alloted for this purpose. Under no circumstances 
was the trainee permitted to take the form home. Excuses 
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such as "I - ftmy eye glasses at Home'* could be cons- 
twied (e:cc?r”t where established as fact) r as an attempt 
to have t.ie "orm filled out by someone else, in order 

to avoid -ch: Lesion of illiteracy. 

All c£ 'the forms were 32 Jturned to BOLT by the super- 
visor. Ir case of individuals who failed to fill out 

the form, a ..1st of literacy training programs in Spanish, 
(free even.- :: courses) was mailed to them by the BOLT 
staff- Only an insignificant number of all workers pre- 
-tested (apor-oximately 10 out of 343) proved to be illi- 
terate in Spanish. The others were invited to an expla- 
natory session ob BOLT which was, in fact, the pre- 
testing session. 

The op tim um number of workers to pre-test in order to 
arrive at s. group of ten with similar language needs ran- 
ges from 13-20. In reality, the average number tested 
ranged from between ten to fourteen persons per group. 

The pre-testing session began with nn introduction 
to the objectives of the BOLT program in Spanish. It 
was perhaps the most significant day in the entire trai 
nxng cycle. The tone was set for the course; the goals, 
curriculum and methodology were made clear to the pros- 
pective trs,tn'e. 

30 
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It was essential to create a relaxed ; atmosphere, 
free of tension and fear, as a forecast of the regarding 
and relevant learning experience to come. The candidates 
were not told that they were going to be tested. Rather, 
they were addressed in Spanish in a friendly and personal 
way. First the project was described as a joint endea- 
vor on the part of the employer, who was interested xn 
helping his workers progress, and the Puerto Rican Forum, 
Inc. a non-profit, self-help Puerto Rican agency, devoted 
to solving specific problems of the community through 
self-help projects. Brochures describing the FORUM and 
its programs were distributed and staff members also handed 
out their personal cards. This personal approach is an 
invaluable fact of the high motivation generated in a 

BOLT course. 

Events scheduled for the day were explained in detail. 



fact was stressed, that only one bus with ten seats 
was available, as was the experimental nature of the pro- 
gram. They understood that not everyone present would be 
able to participate in BOLT at that time because of these 
limitations but that we expected our initial p*ojects would 



succeed because of their 




expansion 



of the program 



cooperation and that would lead to 
o,nd fscilitiss • 
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It was explained that the initial interview and pencil 
and paper exercises would enable us to arrive at a group of 
ten who were at about the same level of English ability. 

It was emphasized that these were not tests to determine 
how "smart" or "dull" the workers were, but to give the 
trainers and linguist some idea as to the extent of their 
exposure to English in its spoken and written forms in or- 
der to proceed to form homogeneous groups. It would, more- 
over, it was explained, be a disservice to the group if 
the levels of exposure to English among trainees were ter- 
rible disparate. It was also important for the instructors 
to determine where to begin in the course in terms of gram- 
matical structures. In order to decide this, it was neces- 
sary to know the English entry level of each worker. 

The candidates were also told that they would be free 
to consult with BOLT representatives during the day on any 
questions that they might have concerning the program. 

Most questions asked centered on the problem of work time. 
The workers wanted to be reassured that the supervisors 
would really be informed about the program and that the 
participants would in fact be released from the job. In 
many instances they asked if they would have time to shower 

and change before class. 

ERiC 
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Emphasis was also placed on the fact that no expenses 
would be incurred; texts and materials were free. Only 

personal writing materials would be purchased on an indi- 
vidual basis. 

The main personal preoccupation expressed was the fear 
of not knowing enough to qualify for the class. Candidates 
appeared v to have the false impression that they had to 
know a great deal of English in order to participate 
in BOLT. Some workers were taking evening courses (high 
school classes or technical training); others had family 
responsibilities or second jobs and were worried about not 
having sufficient time to devote to their English studies. 
These fears were allayed by a description of the programed 
workbook which allows the individual to set his own pace. 
Generally, the response of the candidates to the pre-testing 
day proceedings was enthusiastic: they expressed great in- 

terest in the program; all wanted to participate and were 
eager for the course to begin immediately. The lapse 
of time between the pre-testing and the start of classes 
worried them despite the fact that it is usually only 
several days to one week for those areas in which a course 
had already been offered, and a maximum of two weeks for 

a completely new occupational language area. 
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-t-r-. disassociate the somewhat long. 

An effort was made to disassocidt 

and demanding process of pre-testing from the actual course. 
Candidates were informed that the exercises would appear to 
he difficult and that they would not he able, nor were they 
expected, to answer all questions. The course, 
would he less rigid, totally job-oriented, and would al- 
low for more two-way communication between trainer and 
trainee. Throughout, the attitude was friendly and the at- 
mosphere relaxed. The candidates were ashed to help 
ensure the success of the project as an example to the 
entire Hew Yorh City community, especially as Puerto Ricans. 
They were informed that the tests would be repeated 
the end of training so that progress could be determined. 
This was also true of the recorded interviews which 
they were told not to fear because they would enable the 
staff to remember their voices. Many assurances were given 
so that the pretesting situation was as tension free as 
possible. 



Areas tested, as noted above, were: (1) tbe ability 

to understand spohen English, (2) the ability to under 
stand and read written English, and (3) the ability 
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speak (oral interview) . The non-verbal intelligence 
test (J- Co Raven) was used because of the apparent cor- 
relation between the ability to match the tests designs 
and the ability tc make important linguistic analogies 
in the learning of a second language. Before each test 
was administered, the nature of the test and the test 
booklet were explained. Sample questions were reviewed 



as a group in order to acquaint workers with the test. 



The lack of pencil and paper test sophistication of all 
groups was consistently very high, necessitating many 
clear repetitions, in Spanish of the testing procedures. 
Ideally, no testing should be carried on during the ini- 
tial sessions with the workers, but the limitations of 
space and time demand some method of determining fairly 
homogeneous groups. Nevertheless, BOLT courses still 
tended to include workers with a 20—30 grade point range 
(scale of 100) in the same!', group • 

VI . Curriculum 

A. Preparation of Curriculum 

Preparation of a job— related, tailor-made BOLT curriculum 
starts with a visit to the job-situation. The purpose of 
this visit is to survey the job-situation in terms of special 
:>n-the- job vocabulary needs and to secure any printed materials, 
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manuals and other related literature from the employer and 
supervisory personnel. The new BOLT program. Phase II, makes 
provisions for more extensive pre-course linguistic surveys. 

A day should be spent at the place of employment prior to the 
preparation of the curriculum with a tape recorder so that 
course planning can start with an actual record of the 
linguistic needs of the work situation which is as complete 
and detailed as possible. Job vocabulary lists are devised as 
a result of the linguistic analysis, and distributed to stu- 
dents . 

The most significant aspect of the BOLT curriculum is its 
concentration on the specific vocabulary and grammatical struc- 
tures basic to adequate performance of a particular job. A core 
curriculum of 22 lessons was the basis of every training pro- 
gram, after the incorporation in it of the job-English perti- 
nent to the tasks performed by each training group- Every 
occupational job had its own specially created text or Cur- 
riculum Guide. 

B. Curriculum Areas 

The original BOLT proposal stated that language trai- 
ning courses would concentrate on three occupational areas s 
1) plastics 2) housekeeping and 3) one new area within 
the SAI program. These areas were determined by reviewing 
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SAI * s previous skill training programs and expected ar©as 
o£ concentration. consequently, EOLT recruiting had to 
accept whatever occupations were aVail?" le whan the BOLT- 
SAI relationship did not materialize. The occupational a- 
reas actually served within the BOLT training program, (Phase 
I) were sevens 1) Hospital Housekeepers 2) Housing Autho- 
rity Caretakers 3) Community Action Workers 4) Office Skills 
and 5) Hospital Dietary Service Workers 6) Bank Check pro- 
cessing Operators 7) Consumer Education (unemployed mothers), 
representing formidable research and gathering of materials 
for the creation of suitable curricula. Curriculum Guides 
are available in each of these areas. 

C. Methodology 

The techniques under experimentation were adapted to 
meet the workers* and industries 1 needs for intensive and 
practical English training, linked to the specific job per- 
formed. Well-recognised principles that applied linguistics 
has brought to the teaching of English as a second language 
and intensive skill training experiences are basic to the 
BOLT methodology which proceeded on the following assumptions? 
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(1) The ability to understand (aurally) and 
produce (orally) the basic English struc- 
tures and vocabulary of the job is essen 
tial for communication on the job, compre- 
hension of work casks and participation in 
upgrading programs . 

(2) Each individual member of a group of Puerto 
Rican workers with varying levels of educa- 
tion and exposure to English can best pro- 
ceed at his own pace in the accumulation of 
general English grammar, and in the ability 
to read and write English. This was done ^ 
through programmed instruction, as an auxi- 
liary to the predominantly oral and speci- 
fically job-oriented training sessions. 

1. Audio-lingual Methodology s 

The major emphasis in BOLT is on the ability to 
comprehend (audio) and speak (lingual) English, in 
particular the "language of the job", with secondary 
emphasis on the ability to read and write standard 
English * 

The basic occupational English structures and voca- 
bulary of a particular job should become integral and 
habitual linguistic patterns of the individual worker's 
language, aided by audio-visual equipment such as a lan- 
guage laboratory, visuals , equipment and materials re- 
levant to the job situation that permit constant repe- 
tition and comparison. 
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Exposure to and use of the language of the job in 
realistic job situations maintains bigh motivation 
and reinforces the patterns taught. 

Programmed Instruction ; 

Programmed learning is based on learning principles 
deriving from recent developments in psychology and edu- 
cation demonstrating that students can iraster a subject with 
a negligible number of errors by proceeding through a 
course bv a large number of small easy-to-take steps . 

The worker learns general standard English on his own 
with programmed materials for home assignments >-hat em- 
phasize behavioral situations and the related lexical mate- 
rial of the language, integrated with the grammatical 
patterns of the English language most relevant in each job 
that are stressed in class. 

The worker proceeds at his own pace and largely on his 
own time through a carefully graded, approximately 50 
hours long, and experimentally tested sequence of mate- 
rial as he gains competence in English and receives imme- 
diate confirmation of the correctness of his responses by 
checking the answers . 

, The BOLT trainer instructs and guides the workers 
in the usage of the programmed materials, checks indivi— 
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(■jual progress every day and elaborates upon, an^ 
reinforces them in his instruction of the basic occupational 
language of the job. 

Explicit procedures in the BOLT methodology, including a 
breakdown of the two hour training period ,ar(f included in 
the materials accompanying this report. 



\JXT o post-Testina and Graduation 
A. Post Testing 

At the end of every training cycle, during 
the last two training sessions, careful post 
testing is carried out in order to ascertain the 
learning experienced as a result of BOLT training. 
Forms A of the Lado -Fries Aural Comprehension and 
Structure exams were part of the pre tests ; Forms 
B of both tests are used in post testing. 

The job-related vocabulary post test is a 
list of 10 words devised by the BOLT staff and 




similar to the pre-course job vocabulary test. 

The post-training interview again utilizes 
five introductory questions which parallel those 
of the pre-training interview, supplemented by one 
adapted Thematic Apperception Test picture. 

(Descriptions in accompanying materials) 
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This was a fifth motivational variable that was 
included as criterion data, that is, as an indi- 
rect evaluation of the affective outcomes of the 
BOLT training itself. (The fifth protocol also 
provided an oral interview post-training score 
for language use measurement) . The related vari- 
able measured is : Attitude toward adult training 

and instruction - the picture shows one adult 
in a business suit, pointing out something in a 
book to another adult who is in work clothes . 

This obviously can relate to a training type situa- 
tion. 

The Lado-Fries tests are intended for college-level stu- 
dents from different regions in Latin America. They are, 
therefore, not job-related in vocabulary and therefore, 
use general English structures, not specifically those 
included in the BOLT curriculum. The lack of corres- 
pondence of these tests to actual BOLT training under- 
scores the need to work on and devise specially relevant 
tests . What has been referred to as "criterion reference 
testing", by the Defense language Institute for example, 
creates tests based ox* what the trainee must learn, i.e., 
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a small, limited body of material, and not on what he does 
learn out of a larger body of general material. In BOLT’s 
case the test would focus on whether the trainee could 
perform each and every one of the actual language behaviors 
necessary for adequate job performance, an obviously dif- 
ficult task . Although areas other than vocabulary , i « e * <■ 
structures, would be difficult to determine, such testing 
might prove invaluable in arriving at a true evaluation 
of actual achievement. 

B. Graduation 

Every trainee who finishes a Basic Occupatio- 
nal Language Training course and fulfills his res- 
ponsibilities in class and work assigned outside of 
the classroom, is awarded a BOLT diploma at a 
graduation ceremony at the end of the course. 

Post testing grades are not determining factors 
in the granting of diplomas . The diploma is ins- 
cribed with the following texts 

"This Certifies That_ ~ 

has satisfactorily completed a Basic Occupational 
Language Training course, and has earned the con- 
ferral of this diploma for perseverance and 
accomplishment in the study of English as a se- 
cond language". 

For many of the trainees it represents the first 
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diploma they have ever received for any formal 
instruction- As such, it has great symbolic value 
for the recipients as concrete proof of actual 
achievement, and is, therefore, cherished. Many 
of .the trainees frame the diploma and exhibit it with 

just if ied pride - 

Graduation day for most of the trainees 
takes on extraordinary significance. Graduates 
generally appear in suits not work uniforms for 
the occasion. The importance of the event is 
underscored by the remarks of an appreciative 
graduate who in halting and newly-acquired vocabu- 
lary expresses his thanks to the employer, agency 
and Department of Labor for allowing him to take this 
first step in self-improvement and occupational 
upgrading * 

The ceremonies also include remarks by a top-level 
management representative - usually the president, manager 
or director of the sponsoring firm. A representative or 
member of the Pverto Rican Forum's Board of Directors also 
addresses the group in English and Spanish. 

It is hoped that a significant contribution to the 
graduation ceremonies can be made in the future by the pre- 
erece of a representative from Department of Labor. 
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Inv4sfcations to the graduation are extended by the 
Puerto Rican Forum and are mailed to members of the U.S., 
Department of Labor, the Puerto Rican Forum's Board of 
Directors, management executives, supervisors designated 
by employers and the families of the graduates . 

Appreciation is oppressed by the students in the form 
of a gift to the instructor, a gesture which is iu no 
way encouraged, but which occurred in every training 
group due to the initiative of the workers themselves „ 




44 



41 



V^EXX Evaluation 

- • 

A. Methodology 

The testing methodology is outlined above . Most of 
the variables were obtained from scores on standardized 
tests using the directions for scoring as written in the 
manuals of each test. There were two areas of variables 
that had to be rated, both deriving from the tape recorded 
structured interviews. These were the interview ratings 
for facility in language use and the ratings of motivation- 
al variables deriving from responses to the devised T.A.T. 
stimulus pictures. 

In both cases , raters were trained and instructed in 
the use of a detailed rating scale. The language rating 
scale corresponds to the U. S. State Department foreign 
Service Language rating scale, a O-five point scale on 
which a score of 1= survival use and a score of 5 means 
native professional facility in the language. 

For the motivational variables, the five points scale 
was balanced between positive and negative with minus 
2 representing the most negative and plus 2 the most posi- 
tive. Rating was carried out by at least two raters for 
each subject, and the final rating represented the average 
of two ratings in the case of discrepant ratings. In fact, » 
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there were less than 10 instances of discrepancies in 
these independent ratings. Raters were college students f 
of Puerto Rican background , who were bilingual. 

As a final check, synopses of responses were trans- 
lated into English where necessary and written out, and a 
research psychologist reviewed all the ratings using clini- 
cal skills to assess the strength of positive or negative 
motivation implicit in the response. 

All scores have been entered on a master data sheet 
along with ear' subject's age and length of residence in 
mainland United States. 

Computation of group means and statistical analysis w 
carried out by computer —assisted analysis . 

B*. Scope of Evaluation 

Prom January l y 1968 until February 1, 1969 twenty one se- 
parate training programs were conducted by The Puerto Rica 
Forum in Basic Occupational Language Training for employee 
of varied business and public service enterprises. Each 
program was specifically designed to meet the needs of the 
Occupational group involved. As is seen from the accompa- 
nying table, approximately 8,650 hours of individual trai- 
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not persist or are still scheduled to participate at a 
later date. Most courses ran for 50 hours , with a typi- 
cal course meeting four or five days a week for two hours 
a day over a 5 or 6 1/2 week period. The results of these 
programs were evaluated as described in the following pages. 

TABLE I 



Class 

I 

II 

III 

IV 

V 

VI 

VII 

VIII 

IX 

X 

XI 

XII 

XIII 

XIV 

XV 

XVI 
XVXI 

XVII I 

XIX 

XX 

XXI 

XXII 

XXIII 



Hours 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

50 

100 

50 

100 

100 

In progress 



of Students 


Total 

Hours 


6 


Cancelle 


S 


400 


6 


300 


11 


5 JO 


9 


450 


S 


400 


10 


500 


10 


500 


10 


500 


10 


500 


10 


500 


10 


500 


8 


400 


9 


450 


8 


400 


5 


250 


5 


250 


10 


1,000 


8 


400 


7 


700 


12 


1,200 


174 graduates 


8,650 
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C. Trainees 

The trainees, thus far, have been in groups ranging 
from six to ten in size. One hundred thirty e_i.ght of the 
174 graduates in groups I - XXI were male? 36 were fe- 
male, primarily from groups training for clerical posi- 
tions. The age of trainees ranged from sixteen to sixty 
three with a mean age of 36.09. This implies, quite 
correctly, that most groups consisted of mature men in 
their middle years. Three hundred and forty three wor- 
kers were pretested, 198 selected, 174 graduated, 24 
dropped out. (See appendix), 144 ware from Puerto Rico, 
the others were from Cuba, Dominican Republic, Columbia, 

Ecuador and Honduras. (See ethnic background list). 

D Test Results - Change in Language Scores, based on BOLT 

I - XIII 

The first hypothesis of the project was that lan- 
guage use improvement would result, based on standardized 
tests and rated interviews. Test results are reported in 
Table I. Since the number of subjects approximated 100 
for each variable, (except oral interview) , total scores 
are reported; averages can be derived by the movement of 
one decimal place. However, for net change, the crucial 
variable, both total and average changes are reported. 

Por the oral interview, the pre-training average 
was .9 on a 0-5 scale. This means that the average trai- 48 
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nee had siight3.y less than survival command of the English 
language . Review of indivxdual scores tend to conxinn 
this generality, although there were six trainees so 
close to functional illiteracy in English that they 
received a "O" rating. These cases do not, however, skew 
the distribution to any great extent for the standard 
deviation is approximately .08. 

The post training mean is approximately 3. .6, whici, 
means that the survival level has been exceeded, and 
the individual is moving toward knowledge of and com- 
mand of tenses. The "t" of 4.37 is significant at the 
.001 level and indicates that the results did not occur 
by chance. 

On the standardized test of aural comprehension, 
the m^an improvement was 7.84 points between pre and 
post testing. This is the most significant gain of 
all teste variables . 

Scores on the standardized test of language struc- 
ture also show highly significant gain with a mean gain 
of 7.2fc- which is also significant at the .001 level. 

Job vocabulary was tested by presenting matched 
lists of ten job related vocabulary 3s. Respoa- as 

were sec d on a three point scale based on ■ ua3 
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recognition, aural recognition, partial or no recognition 
of the stimulus word. Posi-tesfc scores average! around 1.2 
for the trainees, indicating partial or incomplete recog- 
nition of job related words . Post“ test scores averaged 
around 1.9, indicating aural recognition of the word, 
but still little indication of visual recognition. For 
this variable, the meaning of the scoring obviates the 
necessity for evaluation based primarily on statistics. 

The statistical analysis indicates, of course, a .66 change 
significant at the .001 level. The change is however, 
from partial or incomplete recognition to aural recogni- 
tion of job related vocabulary not specifically tutored 

during the training sessions. 

The overall result then is a confirmation of the ini- 
tial hypothesis of the study; trainees do show significant 
gains when pre-training means are contrasted with post 
training means. 

E. First Comp. Analysis ' • V * - 

Collection and analysis of data for the BOLT project 

ht.s been proceeding sequentially. The process o data 
collection, in itself, has been more complex than would 
be true in cm experimental laboratory situation. The 
only feasible way to collect data in a learning program 
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conducted at various sites is through a series of care 
fully planned and scheduled group data collection proce- 
dures. The completeness of the data depends on the atten- 
dance of all individuals, a requirement which is not 
always met. 

The data were collected, coded and recorded on mas- 
ter data sheets . The data were then punched on cards and 
the initial analysis was started. 

The first computer analysis based on data from 131 
trainees in the first 14 programs was designed to cal- 
culate means and standard deviation for each of the va- 
riables. Then correlation coefficients were calculated 
for each of the variables with all of the others so chat 
a correlation matrix resulted. The fact that the data 
was not complete for all subjects results in variable 
N's for each correlation coefficient, and the program used 
was written to accomodate this fact. It was necessary, 
also, to calculate separate signif icancies for each 
correlation coefficient, and this was done by converting 
to Z scores and then converting the Z's to standarized Z's, 
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List: of Variables in Matrix 


1 Age 





Residences — Length of Residence in New York City 



3 Pre I 


- Pre-training - Interview Rating 


4 A 


" “ - Aural Test 


5 S 


■' ” - Structure Test 


6 JV 


,s - Job Vocabulary 


7 I 


-Post- Training - Interview Rating 


8 A 


" :1 - Aural Test 


9 3 


" 11 — Structure Test 


10 .JV 


" 11 - Job Vocabulary Test 


11 RAVEN 


Matrices - non verbal intelligence test 


12 EPI P 


- Possessions in home 


13 EPI A 


- Activities & participation during youth 


14 EPI T 


-Environmental Participation Index - Total Scores 


15 TAT I 


— Development education 


16 TAT 2 


- Work orientation 


17 TAT 3 


- Attitude to authority 



18 TAT 4 - Adult assertiveness 

19 ORIGIN - New York born, Puerto Rican born, other 

20 Years or' School — (whether on mainland or in Puerto Rico) 



:2 



21 Criterion - Measures and ratings 



49 



^ CORRELATIONS OF LANGUAGE CHANGE SCORES WITH DEMOGRAPHIC. 

ARP MOTIVATIONAL VARIABLE S 

What demographic and motivational variables are 
most closely related to training success as measured 
by significant (.01 level^ correlations with language 
change scores? Results of the correlation?'* analyses 
are inconclusive , since these are but few positive corre- 
lations, as well as some negative correlations. Length' 
of residence on the mainland correlates positively (.38) 
with change in interview rating, but negatively with the 
other three tests. (aural -.18, structure .-39, job voca- 
bulary -.52). 

Change in the aural test soores was positively cor- 
related with the number of years of prior schooling com- 
pleted by trainees (.18). A positive correlation (.17) 
also appears between the work orientation motivational 
variable and improved scores on the structure test . 

A possible interpretation of this correlation is that 
those better oriented to work perform strv ctured training 
tasks more efficiently. 
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The correlation analysis suggests various possibilities 
for further analysis by analysis of variance, (biserial) cor re 
lation, and possibly cluster analysis, 

9 ICTTERCORRELATlObS OB’ LANGU AGE TESTS. 

An examination of the correlations between the four lan- 
guage tests reveals the following as outlined in two sub-ma- 



trices s 



Table 1 
Interview 
Structure 
Aural 
Job Voc- 



- Sub-matrix of Language Test 
3 4 5 

3 x .16 . 27** 



x 



, 62 *’ 



5 

6 



x 



Pre-Scores 

6 

.35** 

.3 7** 
.41** 
x 



* *s ignif icant at the . 01 -.svel 

Of the pre-tests, all are intercorrelatad significantly with 
the exception of the interview and structure tests. The Aura- 
ana Structure tests appear to be so highly correlated as to cre- 
ate a presumption of overlap. The other tests are positively 
correlated but the overlap appears to be minimal. For the Aural 
and Structure tascs, the extent of shared variance is at about 
the .38 level. (The square of the correlation coefficient). 
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Table 2 - Sub-matrix of Language Test Post-Scores 

7 8 9 10 



X 



.36** .33** .46** 

x .76** .57** 

.51** 



x 



Interview 7 

Aural 8 

Structure 9 

.Job Voc. 10 x 

**signif icant at the .01 level 

As might be expected, the post training tests show greater 
homogeneity in higher positive correlations. Once again, the 
highest correlation, implying very extensive overlap nr shared 
variant a is found between the Aural and Structure tests where 
the shared variance appears to approximate the 58 level (the 
square of the correlation coefficient). The correlation between 
interview rating and aural test scores which was positive hot 
nonsignificant for the pre-training scores, now is found to be 
significant at the .01 leve 1 for the comparable post training 
scores. 

Of greater interest are the correlations between pre-training 
and post-training test scores. The size of these correlations 
depends not on gain but on variability of gain. The results are 
as follows 2 
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Table 3 - Pre-Post Test Scores Correlation 



Variables 

3 
7 

4 
3 

5 
9 

6 



** 0.1 level 



;Sub js . 


Mean 


St .Dev. 


Corr . Coef. 


Stand Z 


91 


12 . 3 


5.01 


.39 


•!< 

* 

00 

CO 

ro 


91 


15.4 


5.81 






117 


46.9 


17.2 


.69 


8 . 93 *** 


117 


55 . 9 


17.3 






112 


41.9 


16.4 






112 


48.5 


15.9 


.85 


12 . 97** 


99 


16.3 


10.7 






99 


20.7 


5.8 


.37 


3 . 8** 






* 


.001 level 




nere is 


interesting. The 


standardized te 


iStS 


a high 


level as 


to imply 


rather limited 


varia- 



biiity of gain. The interview rating and job vocabulary scores 
correlate at a much lower level, and there is a reasonable 
presumption of variability of gain. 



SECOND COMPUTER ANALYSIS CHANGE SCORES ON LANGUAGE TESTS 

(Based on 21 Groups) 

The principal finding is that there is significant gain in 
all the language scores between the pre— training testing and 
the port training. The "t" tests of significance of difference 
of means are significant for all variables indicating that other 
than chance improvements have '-"'crrred . 

Concentrating on the meaning of the significant improve- 
ment in the interview rating, we note that most of our students, 
whose use of English ir- conversation was rated as less than 

ERLC 56 
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"ff--rvival level" prior to training, reached and surpassed 

■Chat mii lmai level after training . 

s'ditional analyses were performed to gain understan- 
ding of tlie interrelationships of the variables studied. 

It was found that the language tests were fairly dis- 
tinctive, although the standardised tests of Aural com- 
prehension and Structure overlapped. They measured the 
same area to a large extent, both before and after train-,. 

ing. 

These twe tests also had less variability of gain than 
did the interview and Job Vocabulary tests. If we mafce a. 
distinction between formal language use and informal lan- 

■ t 

cmage use, the Aural and Structure tests relate to formal 

w , : v . ' 

use. The gross change was greater in the informal lan- 

: '*} \ " * * 1 

guage tests, but this is due in part, to the lesser va- 
riability of these scores. 

Tho mean changes and standard deviations are as fol- 
lows 5 ' ■ 



VARIABLE 

Interview 
Aural 
Structure 
O Vocabulary 

ERIC 



RANGE OF SCORES MEAN CHANGE STANDARD FIRST ANALYSIS 
R£|3GE ut aww. DEVIATION MEAN CHANGE 



0-10 

30-80 

30-80 

6-10 



4.69* 

9.6 

6.1 

3.7* 



10.5 

15.5 
11.1 
12.1 



SCORES 
3.3** 
7.84 
7.28 
2.2 
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* For computational purposes, the decimal point has been 
moved one place . 

** Scores are reported in comparable form. 

In summary, it is evident that significant change 
was effected in tooth the informal and formal language 
use of the trainees, consonant with the findings of the 
first computer analysis? The change as measured toy this 
analysis is greater for all tests except the structure 
tests where the first analysis reports a change of 7.28 
points and the second a change of 6.1. The difference is 
not significant. 

1 - INTERCORP.ELAT IONS OF CHANGE SCORES 
The change scores are based on the post— training 
language scores minus the pre— training scores on the same 
tests. They intercorrelate as follows? 





X s 


A 


J V 


Interview 


X .00 


-.46** 


-.50** 


Structure 


X . 


.24** 


.11 


Aural 




X 


to 


Job Vocabulary 






X 


** significant at 


the . 01 level 
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The highest positive correlation is between the 
Aural test and the job vocabulary test. Change on 
these tests appears to proceed in the same direction. 
ijvj-jq structure and Aural tests, similar in origin and 
administration, are also positively correlated in change 

scores . 

The significant negative correlations between the 
interview change scores and the aural and job vocabulary 
change scores are not only the largest correlations but 
also raise additional questions with regard to the in- 
terview ratings. These ratings correlate in positive 
fashion with two of the three other tests given during 
the pre-training testing, and with all three of the other 
language scores in the post training testing. However, 
changes in these scores do not correlate in a posi 
tive fashion, but in an inverse relationship. One pos- 
sible explanation derives from the "halo effect" m in- 
terviews ratings . 

The positive correlation of Structure and Aural test 
change scores is consonant with thefl&iagree of overlap 
found in the previous analysis between these tests. 



o9 
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2 INTERCORRELATIONS OF MOTIVATIONAL AND DEMOGRAPHIC VARIABLES 

The motivational variables derive from the use of thematic 
apperception test type presentation of four pictures, (see Description 
of Language Tests in Appendix) about which the respondents are instructed 
to tell stories. The first picture, showing a boy at a table touching 
a large, massive booh, relates to attitude toward educational development. 
The second, a picture of an older, formally attired man talking to a 
younger, shirt-sieved man near a machine, relates to attitudes to work 
and supervision. The next depicts a police like figure with his hand on 
the shoulder of a moustached man, and relates to attitudes toward 
authority. The fourth, showing an impre ssive man standing at a podium 
addressing a group, relates to attitudes toward self- assertiveness. 

The intercorrelations of these four variables are as follows: 





ATTITUDE 


1 2 


3 


4 


1. 


Educational 
De ve 1 opine nt 


x .10 


.35** 


37 ** 


2 . 


Work & Supervision 


X 


.18 


29** 


3. 


Authority 




X 


.19 


4. 


Self- assertiveness 






X 



**-significant at the .01 level 
The overlap is slight : the four variables are positively 
interrelated at a low level. The highest correlation between educational 
development and self-assertiveness commends itself readily in logical 

terms . 

O 

ERIC 



60 



The Environmental Participation Index (appendix) is designed as 
easure of functional socio-economic developmental status by asking 
respondent what things he had in his home when a youth, and what 
dvities he engaged in then. These two parts of the EPI correlate 
the high level of .48. The total scores on the EPI correlate in 
iitive, but nonsignificant fashion with the TAT motivational variables 
s correlations of the EPI total scores and the motivational variables 





EPI 


Total Correlation 


Standarized 


icational Development 




.40 


2.0008** 


rk and Supervision 




.27 


1.318 


thority 




c 05 


0.242 


lf-assertiveness 




.34 


1.566 


**signif icant at the 


.01 


level 




Although the EPI has some 


overlap between parts, v 


note that 



ere is a negative correlation of -.34 between age ar die activities 
irt of the EPI. The older the respondent, the less 3 cexy that he 
irticipated in a wide range of designated activities. 

>llow up - Job Performance a nd Progress, 

Since the key question related to the BOLT project involved the 
frfect that participation had on the job performance and progress of. -the 
trainees, a major follow-up data collection program was instituted 
fter a suitable interval. 
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The design of follow up study involved a return visit to the 
training site, the work locus, by a member of the BOLT evaluation staff. 
Interviews were held with the trainees, their first line supervisors, 
and a representative cf upper management (from second level supervisor 
up). The interviews were structured so that each interview involved 
filling out an interview rating form in which aspects of BOLT training 
were rated and comments upon as well. Trainees had little difficulty 
in responding to the structured interviews, and most ^xrst lir* super- 
visors needed very little assistance as well. It was found, however, 
that second level supervisors and other management personnel were not 
always adequately acquainted with details of the BOLT training or with 
specific subsequent effects. Their evaluations tended to be global and 
general, and thus of lesser significance in evaluation terms. Never- 
theless, their comments were often representative of positive attitude 
changes, and the occasion to discuss the BOLT programs gave them an 
additional opportunity to consider the program's contribution to job 
up-grading of the trainees. 

The basic qualitative score for follow-up criterion data was 
arrived at according to a variable formula. The range of scores wa 
from 0-50. If, for a particular trainee, a rating form * had been filled 
out with the trainee, his first line, and his second line supervisors, 

scoring was as follows: 

*See Appendices 

O 
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1. 10 item supervisor rating sheet 

(3 points each item: 

1 , 2 , 5 - 12 ) 



30 points 



2. 10 item trainee rating sheet 

(1 point each item^ 1-10) 10 points 

3. 5 item upper level supervisor 

rating sheet 
(2 points each item: 

3, 4, 5. 6,8) 10_points 

50 points 

In caseo where either trainee ratings or upperlevel supervisor 



ratings were not obtained, the 10 items of the first line supervisor 
rating forms were scored with a 5 point value, giving this rating form 
alone a 0-50 point range. The scorable items were predesignated from 

among tli© items on this crating sheet # 

In addition to the elements specified and rated, all interviewers 
were encouraged to discuss the program and its impact xn broader terms. 
Other significant correlations are between age and residence (.46). 

!. changes in Job Situation. Job Up-grading, Retenti on, Promotion, ., et c^ 

The inclusion of retention as a measure of job up-grading ~s not 
a common practice. In the case of the trainees involved in the BOLT 
program, however, it is not only justifiable but appropriate. 

Eight BOLT programs were conducted with employees of the New 
York City Housing Authority. Ten programs were specifically desxgned 
to assist trainees in taking a Civil Service Examination; 8 for Housing 
Authority Caretakers, 2 for Department of Hospitals, Housekeepers. 

At the time of training, these trainees were provisional employees. 
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r continued tenure on the job depended on their passing of the 

ropriate Civil Service Examination. 

The New York City Department of Personnel does not. compile 
:istics of differential rate of failure on these examinations by 
lie groups. In personal communication, however, officials of this 
artment have disclosed that the failure rate among applicants with 
dish surnames is very high. In one unofficial survey, it was 

imated at 88%. 

The problem follows a well established routine. Men are hired 
housekeeper aides, or caretaker aides on a provisional basis. They 
the work efficiently enough to be retained in this capacity. 

By law, however, when an examination is scheduled, they are required 
her enter to qualify for permanent employee status by passing the 
ri l service Examination or be terminated. For Puerto Rican New Yorkers, 
iir difficulties with the English language make this examination an 

posssing barrier. ** i 

The table attached gives the names, scores, civil service liert 

d BOLT group numbers of those who passed the Housing Caretakers 

amination. The official statistics at the bottom of the table indicate 

at of the BOLT trainees 27 passed of 67 in the programs, and, inci 

ntally, of 56 who actually took the examination. This contrsts with 

general rate of 1,500 passing the examination out of 2,400 applications 

ie 48.2% passing rate of BOLT trainees is apparently less than the 

>.5% general rate of success on the examination. Yet when it is 
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contrasted, with the unofficial success rate of 12% of Spanish-speaking 
applicants who receive no special training, it represents an apparent 
achievement of considerable dimension. 

BOLT Students - Housing Caretakers 

PASSED 



NAME 


SCORE 


CIVIL SERVICE LIST # 


BOLT 


GROUP 


Heriberto Gonzalez; 


98 


857 


BOLT 


V 


Orlando Mendoza 


98.700 


691 


II 


V 


Carlos Valentin 


91 


1170 


ll 


V 


Diosdado Rivera 


88 


1244 


U 


VII 


Alfredo Correa 


80 


1445 


it 


IX 


Victor Feliciano 


98 


871 


II 


IX 


Gorge Quinones 


84 


13 3 5 


II 


IX 


Felipe Torres 


84 


1360 


II 


IX 


Oosd Martinez 


103.700 


194 


tl 


IX 


Dal fin Ramirez 


98.40u 


752 


i ( 


VIII 


Antonio Coriuno 


86 


1296 


II 


VIII 


Ramon R. Pdrez 


98.700 


688 


II 


VIII 


Ramon Rivera 


90 


1217 


II 


X 


Ramon Rivera 


72 


1576 


II 


X 


(St. Nicholas) 










Miguel Alvez 


80 


1463 


II 


XI 


ITc ry Caro 


88 


1248 


It 


XIII 


Luis A. Coldn 


76 


1539 


It 


XIII 


Israel Crus 


78 


1490 


ll 


XI 


Antonio Ferreira 


98.400 


700 


ll 


XI 


Gregorio L6pez 


92 


1111 


II 


XIII 


Victor Martinez 


81 


1428 




XI 


Victor Mdndez 


76 


1521 


II 


XI 


Angel Rivera 


80 


1459 


It 


XI 


Rosario Reyes 


84 


1355 


II 


XIII 


Justino Santana 


90 


1195 


II 


XIII 


Manuel Suarez 


84 


1385 


II 


XI 


Jo sd Rivera 


80 


1471 


If 


XI 



Took Exam 



Passed 



In BOLT Course 

O 

iLT Students - Passed 



2400 

1500 

67 

27 
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SLAT I ON OF LANGUAGE CHANGE SCORES .W -gTH SUPERVISORS; - — 

Do changes in language proficiency relate to improvement in job 
Dr mane e as rated by supervisors? Our data fail to demonstrate such 
lationship- Correlations between language change scores and super- 
r ratings are as follows: 

CHANGE IN CORRELATION WITH SUP ERVISOR ' S RATINGS 

Interview 

Aural # ^ 

Structure - 11 

Job Vocabulary * 04 

None of these low correlations are significant, so o-ne cannot 
:rt a relationship between language improvement and suvervisory 
:ngs on the basis of the data. The evidence of a relationship 
,een language improvement and improved work effectiveness derives 
bead from the content of the trainees, supervisors, and upper level 
srvisors’ comments in evaluating the program as well a s from .retention 
job up-grading data presented in Summary of Intensive Fcllow-up 



vey of 38 BOLT Graduates. 

The correlations reported above are based on a small, sample (N=38) 
four training groups which were selected for reasons of feasibility 
her than randomly selected. With such a small sample, highly 
lS ed or unreliable ratings by a single supervisor would have undue 



.ght . 

Evidence of such bias or unrealiability can be clearly adduced 
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a additional correlations found between, supervisor 



s 



ratings and. 



;r variables. 



VARIABLE 



an Matrices 
itude to Authority 



CORRELATION 

WITH SUPERVISOR'S RATINGS 



SIGNIFICANCE 
LEVEL 



.29 



2 . 104 ** 



- . 62 



2 . 568 ** 



** significant at the .01 level 



Supervisor's ratings correlate in positive fashion with Raven 
rices scores,, which, measure not only intelligence but an acculturation 
tor. They correlate in negative fashion with attitude to authority 
res, a finding that suggests that passive acceptance of authority 
• foe related to higher ratings of inf^ercvenient . 

Conclusive discussion of the relationship between language improve - 
it and supervisors 1 ratings must await additional rating data. 

iLUATIONS of bolt -programs by first level su pervisors 

Given the disparate nature of the training sites, curricula and 
rposes , the evaluations by first line supervisors showed a high degree 
consistency. The over all evaluation of the program was highly 
5 itive in the more structured work settings, particularly in industrial, 
iical and other civil service settings. The programs conducted with 
ighborhood groups, and in an other setting where the trainee's 
ientaticrv to the program was less favorable (because of a less direct 
lationship to jobs and job up-grading) were evaluated in less positive 
Shicn. Supervisors of the New York City Housing Authority gave 
sitive over-all evaluations, although in one case, the supervisor 
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mentioned extensive trainee resistance to the program because trainees 
were not selected for the program, but ordered to attend, and had to 
give up their lunch hour and coffee breaks. 

4 o sUVmBY OF INTENSIVE FOLLOW-UP SURVEY OF 38 BOLT GRA DUATES 

To determine what effect a fifty hour BOLT course has on a worker’s 
performance, upgrading, English-speaking ability and morale, effective 
at least 6 months after graduation, an intensive follow-up study of 38 
graduates of four different BOLT courses was conducted: BOLT II for 

eight hospital housekeepers at Welfare Island; BOLT IV for eleven young 
adults in the South Bronx Concentrated Employment Program Office Skills; 
BOLT V for ten housing caretakers at the Eastchester Gardens Housing 
Authority; BOLT XIV for nine community action workers at Massive 
Economic Neighborhood Development (MEND). One training site, Montefiore 
Hospital, conducted a complete ~ independent evaluation, highly favorable 

(See APPENDIX) 

The four BOLT groups mentioned above were selected for study because 
they seemed representative of the variety of occupations which have 
received BOLT training. Individual interviews were held with the 
graduates and with their supervisors.* The data thus collected was 
evaluated and three main conclusions emerged. 



* Several graduates were not interviewed because they were absent 
from work or had moved to new job sites ; one supervisor, - 
Herschf ield of Eastchester Gardens Housing Authority, was unable 
to particularize his comments' because he lacked knowledge of the 
graduates of BOLT V Caretakers supposedly under his supervision. 
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NOTE 1 



O 

ERIC 



(1) 71% of the graduates moved up in vario us ways: 

All eight housekeepers in BOLT II passed Civil 
Service Exams and became provisional housekeeper 
supervisors; eight of the eleven unemployed trainees 
in BOLT IV Neighborhood Youth Corps completed a 
skills training program; five of the ten housing 
caretakets in BOLT V passed Civil Service Exams; 
six of the nine community action workers in BOLT 
XIV participated in a special English-sociology 
program at Columbia University. (See note 1) 

(2) All of the supervisors except one (w here BOLT 

was not voluntary and passed the wor ker's — lunch 
hour) felt that the BOLT course had hel ped their 
workers communicate in English while at the same 
time had increased their job effectiveness, 
morale, promotability and relationship with peers 
and management. (See note 2) 

(3 ) Most of the graduates felt that in addition 

to helping them improve their English, the BOLT 
course provided a positive learning experience. 

(See note 3) 

1 BOLT II - Wel fare Island - Hospital Hou sekeepers 

A7~Avil<§s* *** *passed Civil Service Exam 

V*. De Santiago* and became provisional 

F. Diaz* housekeeper supervisors; 
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NOTE 1. 



NOTE 1 



NOTE 1 
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1 (Cont.) 

D. Figueroa* ** *** 

I. Gonzalez* 

H. Lagares* 

A. Ortiz* 

J. Ramos* 



** singled out as being especially 
ambitious and capable of higher 
positions ; 

***are continuing tbeir schooling; 



2 BOLT IV - South Bronx Concentrated Employment Program - 



Adolescents -Office Skills 

I. Alicea 

J. Amadeo 
Cosine* 

Crespo* 

Figueroa* 

Hernandez 

I. Iraola* 

C. Marias* 

B . Melendez * 

O. Rodriguez* 

L. Vazquez* 



J. 

D. 

C. 

P. 



k iV 
** 



*completed a shills training 
program at the Neighborhood 
Youth Corps. 

**enrolled .in and completed a 
second shills training program 
as hey punch operators and are 
presently awaiting job placement, 



3 



BOLT V - Eastchester Gardens Housing Authority - Housing 



Caretakers 
H. Gonzalez* 

J. Medina 
J. Mendoza* 

A. Pagan 
J. Pagan 
A. Rosario* ** 
C. Valentin* 

J. Valentin* 

M. Vazquez 
J. Vega 



*passed Civil Service Exam 

**highly recommended by his 
supervisors; received a 
promotion to a position 
requiring fluency i-nsrs-pohen 
and written English 



4 BOLT XIV - Massive Economic 
Community Action Worhers 
F. Cedeho* 

L. Coldn* 

H. Del Valle 

I. Gonzalez* 

C. Lanausse 

R. Morales* 

A. Ortiz* 

F. Rivera 

S. Serrano* 



Neighborhood Development — 

*enrolled in a special English— 
sociology program at Columbia 
University meeting three times 
a weeh for a full semester; 
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NOTE 2 A sampling of comments by supervisors,, senior workers, 
and training directors. 

BOLT II 

"Mr. Arcadio Z-lvilds H . A. at Central Nurses Residence attended the 
English Classes given by your department during the past winter 
and I am very happy to report to you that his English appears to be 
r greatly improved. " 

a memo from V.C. Barry, Director, Central 
Nurses Residence City of New York 

"This> is to inform you that the English course conducted at Goldwater 
Memorial Hospital by the Puerto Rican Forum, Inc. was of great help. 

It served to increase the morale of the employees whose grasp of 
English and added to their comprehension and communication skills. 

This course has been a benefit both to the employees and the hospital. 

a letter from R Alvarez, 3r. Housekeeper, 
j Goldwater Memorial Hospit 1 

"The group (BOLT II) works better and has more jot responsibility and 
| job satisfaction. " 

from an interview with Mr. Riera, Senior 
j Housekeeper, Welfare Island 

" as you can see, the feeling is that the program was helpful to 

| ; those who participated in it. Again, many thanks for your assistance 
in making the English classes available to our staff. " 

| | from a letter of Leon Adler, Ch ,ef of 

Training, Department of Hospitals, 

. • New York City 

1 1 

BOLT IV 

1 i "Their English is still very poor but I think they have a better 

attitude toward achieving.... Mr. Rodriguez had perfect attendance 
rj during his key punch training, received high grades and will make a 
1 good employee. " 

from an interview with Mr. Oscar Garcia 
Supervisor, South Bronx Concentrated Employment 
Program 
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BOLT V 



"At first the men were very enthusiatic about the program and spoke 
about it among themselves and did do their assigned homework. Later 
during the course ent'nusiam died out. I don't know why and I don't 
know enough about the men to say anything about them individually. " 

from an interview with Mr. Herschfield, 
Supervisor, Eastchester Gardens Housing 
Authority, where BOLT, took the men's lunch 
hour and was not voluntary. 



BOLT XIV 



"The training gave them the ambition to continue their education 
and to search for better prospects for the future. " 

from an interview with Mr. Quihon.es, Director 
of Training, Massive Economic Neighborhood 
Development 

NOTE 3 A sampling of comments from the BOLT graduates: 

BOLT II 

"I am doing very well in Metropolitan Hospital Center. In this job 
I am in charge of the linen room, basement, garbage detail and soiled 
linen room. I have come across some assignments that I had to use all 
my ability and training I have taken to do my best. I feel the course 
[; taken with Miss Zentella, Director of BOLT Puerto Rican Forum, Inc. 

' wa s of tremendous help to me in my present assignment. The classes 

I am taking at New York Community College in Brooklyn, New York. - 
| j I am doing very well. " 

A letter from V. De Santiago, formerly a 
I; housekeeper at Welfare Island 

"I want to take this opportunity to thank and compliment the City 
f j of New York and the Puerto Rican Forum and staff, for the wonderful 
English course given to me. Having better knowledge of the English 
language made it easy for me to go for a civil Service test for house- 

I ; keeper position. Today I have more peace of mind and a better sence 

of humor, I have improved greatly on my daily assignments because 
r now I communicate better. " 

[1 

A letter from I. Ramos, Building Supervisor, 
r i Goldwater Memorial Hospital 

I I o 
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"I take this opportunity to express my gratitude to the Puerto Rican 
Forum ior L' 2 English course that I attended at Goldwater Memorial 
Hospital- - really appreciate it because with they help, now I can 
write, read and speak bettor English- 

A letter from H. bag ares, supervisor, 

Go Id. rater Memorial Hospital 



E, 



{ ! 
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BObT V 

"I can correct ray own mistakes and I can s ah to most of the people 
in this building- I'm going to take ^ the fireman exam and try to get 
a better paying job than I have novn 

From an interview with Heriberto Gonzalez, 
Caretaker, EaStc'ftaster Gardens tjousing 
Authority 

-It's easier for me now to ask for tools and materials and I probably 
have a better chance for a promotion in the future but I'm not going 
to look for a better job because I don't want to press my luck. 

Efrem an interview with Jos4 Mendoza, Caretaker, 
East chestef Gardens Housing Authority 

D ISCUSSION 1. Three Main Points 

Other than the positive result that language improvement does 
in fact occur, and that -Vt contributes to job retention and up-grading, 
what other inferences can be made from the data? The data include 
Only the two computer ^cxalyses but also the range of evaluation data 
compiled: ratings, coyw^nts , institutional evaluations, and job 

retention and up—craclincj information. 

The following points began to emerge: 

a- The assumption tftat older men resist training is 
unwarranted for duo to concern for the concept of 
personal dignity, significant increases of language 
competency occur with students in their forties and 
even fifties. 
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b. The creation of couue content built around the 
specific job needs of the group is an important 
factor in the effectiveness of the program’s train- 
ing procedure, 

c. People with diverse backgrounds, varying ages and 

different levels of competence in language use show 
significant improvement within the relatively short 
training period. 

It would appear that the BOLT trainees began with very limited 
uage usage and have made significant improvement. This is true 
all of the participants; however, it is most evident among the 
>r students: early forties (40-43) and late forties (47-49). The 

? demonstration project has yielded apparent evidence concerning 
; at ion of adults with regard to language training. The statistical 
alts indicate that effective compensation was mad'- for • ;ef of; 

, background, and non-native language adequacy; while we are aware 
variation in native language adequacy, no measures of this variable 

a made. 

Evaluation of adult training programs, particularly those involv ing 
cruaga, yield widespread evidence of resistance to the role of 
ident. The BOLT program, by bringing the training to the studen— 

:ing it clearly relevant to his job situation, and comrrunlcating .,o 
:itude of respect for the trainee's dignity, has not encountered such 
isible resistance. Both student and supervisor evaluations of their 
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a<Hw factors. consanguinity 

.raining experience stress these positive 

• ,1,0 cited as a significant factor both by trainees 

>f the trainers is also cited as a y 

ind by the evaluators. 

Xn summary . it has teen demonstrated that the method is effective, 
and that part of this effectiveness due to a trarnrng context o 

consanguinity and concern for the trainee dignity. * -y factor rs 
specially created. 3 oh relevant training material an, methodology well 

based on principles of applied linguistics. 
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APPENDIX 



Tables I and II 
Schedule of Courses 
Phase I 

Ethnic Background 

Background Information on Student (Occupational) 
Informe Biogr&fico (Biographical Information) 
Oral Interview 

Adapted TAT Pictures - Oral Interview 
Oral Interview Rating Sheet 
Tob-Rel ated Vocabulary Test 
Curriculum Guide Outline 
Training Session Breakdown 
Upper Level Supervisors Sheet 
Supervisor Rating Sheet 
Student Ratings 
Monte fiore Evaluation 
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Table II 



PUERTO RICAN FORUM, INC. 

BASIC OCCUPATIONAL LANGUAGE TRAINING 



Description of Language Tests 
1. Oral Interview - Scale 0-5 

A 15 minute conversation with five standard questions to test 
various tenses (present, present perfect, past, future and condi- 
tional) followed by responses to 4 specially prepared drawings in 
the style of the Thematic Apperception Test of Dr. Murray of 
Harvard University. The post training inverview uses a fifth 
picture. (Also attached) 

The first picture, for example, shows an adolescent standing 
near a table with one hand on a thick book, which resembles a dic- 
tionary or text book. The subject is asked to tell a story 
describing what is going on, what led up to it, how the person 
feels and what the outcome will be. Ratings of the responses have 
been made by our research psychologist and/or his associates. 

The English rating (on a 0, 0+, 1, 1+, 2-5) scale 1/ is of general 
language use and fluency including factors of word choice, mostly 
of forms, pronunciation, enunciation, use of appropriate tenses, 
etc. The standardized interviews were all tape recorded since 
their content involved responses to stimuli related to the motiva- 
tional variables described above. 

O 1/ The tape recordings were rated separately for language use in a ( 
JC conversational situation, following Foreign Service Institute 

criteria# 0—5 seals. 



2. Aural Comprehension 
Designed by: 

Charles C. Fries, Director 
Robert Lado, Assistant Director 
English Language Institute 
University of Michigan 

Copyright 1956 

Scale: 0—100 

Format: Tape recorded sentences demanding comprehension and 

retention relating to pictures and multiple choree 
sentences . 

3 . Struc cure 

Designed by: 

Charles C. Fries, Director 
Robert Lado, Assistant Director 
English Language Institute 
University of Michigan 

Copyright 1946 

Scale: 0-100 

Format: The first 92 questions are multiple choice and the 

last 58 questions are designed to determine the 
abilities of the respondants with regard to the use 
of grammatical structure. 

4. Job Vocabulary 
Scale: 0-3 



0 
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Format : 



Specially devised vocabulary tests with a sample of 
ten words relating to the specific job situation of 
increasing difficulty. Since this test is presented 
visually and (if needed) aurally, the score earned 
by the trainee is not merely a yes or no rating, but 
indication of working mastery of the specific 
vocabulary. 
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PUERTO RICAN FORUM, INC. 

BASIC OCCUPATIONAL LANGUAGE TRAINING 
PHASE I 
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BACKGROUND INFORMATION ON STUDENTS. 



Name 

Place of Birth 



Date of Bitth 



F.DUCAT IONAL BACKGROUND 



Elementary 
Other 



High School 



OCCUPATIONAL EXPERIENCE 



(List only positions held in New York City) 



1 . Present Company - Nature of Work 

Date: From 

Salary . 



2 . 



Comp any 

Date : From 

Salary 

Reason for leaving: 



Nature of Work 
To 



3 . 



Comp any 

Da te : Fr om 

Salary 

Reason for leaving: 



Nature of Work 
To 



4 . 



Company 

Date: From 

Salary 

Reason for leaving: 



Nature of Work 
To 
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Lugar de Trabajo 

Haga el favor de llenar esta planilla con toda la informac 
necesaria en espanol . Toda la informacion se considerara perse 

N ombre ____ 

Direccion 



Edad 

Lugar de nacimiento 

Tiempo en Nueva York 

Anos de escuela 

Lugar de la escuela 

AEs usted casado o soltero? 

Hi jos : numero edad (es ) 

AEn que trabaja usted? 

Departaraento 

Sueldo . 

floras de trabajo 

APor que desea isted participar en este programa? 



Prograna BOLT: 

Profesor: 

Ausencias: 
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PUERTO RICAN FORUM, INC. 
BOLT PROJECT 
ORAL INTERVIEW 



I. 



II. 



Present Tense 
Present Perfect 
Past Tense 

Future Tense 

Conditional 



Introduction 

A. Greetings 

1. Buenos dias sehor, senora, senorita 

2. Yo soy 

3. Si^ntese por favor 

4. Como usted sahra pensaraos coraenzar un 
un programa de inglds y me gustaria 
conversar con usted por un ratito en 
inglds, destS bien? 

Procedure 

A. Questions for Initial Interview (Pre-Course) 

Put tape recorder on 

1. What's your name? 

2. How old are you? 

3 . Where do you come from? 

4. How long have you lived in New York? 

5. What sorts of things did you like to do 
when you were a child? 

6. What will you do when you take your 
vacation? 

7„ If you had Rockefeller's money, where 
would you must like to go? 




B . 



Pictures - Now I want you to use your imagination 
and make up a story for me. 



I am going to show you some pictures. I \s 
like you to tell me: 

1. What's going on? 

2. What is the reason for that? or What 
caused it to happen? 

3. How do the people feel? 

4. What will he the result? 
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* Rating 



Date : 
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i ! 

• i 

, 1 1 ! 


Prpfl. Pe^nfrGCt 




? ! ! 

\ 1 

i 1 * 


c;-h — 




» \ 
I 






t 1 : 


mnrl t +* *i nnal 




i 

» 

I - 1 


Word AcTr-^fMTiont — . , ■ -4 




} 1 

i 1 

| — . — 1 


poi' — "\7eirT3 — < 




i 

*- — — 1 — “I— 


i 

Oirdoir — 1 


. j 

i * j - 


ArH — noun 


| ; ! 

i 1 — ; 




~ ^ — — i- *■ 1 — ■ 




1 

! , 


Nouns : 


t 

-4 




} t 

i 

, - im * 


PriRfi(=*sfiives - 




Fipmnn rat i V6S 


i 




L — j — ■ 


Pronouns — ■ 


n — * • 

! ; 

i 1 1 

i » , 



\ 



i 



idiomatic expressions — 


— t : 

i 

1 i ? 

■ » 




i 


i 

\ 




5 diomatic expressions 


: i 

» ! 

i f 


ronnrfite infOOTation 


} 1 

L ; 


Pronunciation — — — - 


* i 

! i 


i i 

1 

i ' 




102 



PUERTO RICAN FORUM, INC, 

Basic Occupational Language Training 

(BOLT) 

OCCUPATION : CARETAKERS 

JOB-RELATED VOCABULARY TEST 

Worker * s Sheet 

Ir-strucciones : (Lea en voz alta) 

Em este ejercicio usted debera explicai" en ingles el signifi- 
cado de cada una de las siguientes palabras. Lea cada una de las 
palabras en voz alta cuando el prof esor se lo ind3.que . 



rubbish 



1. 
2 • 


X. MJulJ^JLi^i.4 

injury 










3 . 


wringer 










4* 


chamois 










5 . 


alarm box 










6. 


corn broom 










7* 


hallways 










8. 


scrubber 










9. 


sprinkler 










10. 


weeds 











ERIC 



LOCALE : 

PRE: X 

POST: 
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PUERTO RICAN FORUM, INC. 

Basic Occupational Language Training 
^criculum Guides Outline 



Unit I - Dictionary Drill 

This and That in negative and affirmative statements 
and questions . 

2. Negative and affirmative questions beginning with .is. and 
isn't . 

3. Negative and affirmative answers (yes, it_is.. NO £ __it 
isn; t ? .. 

4. Tag ending: "is it?, isn't it?" 

Unit III - Lesson 2 

1 . Negative and affirmative statements beginning with these 
and those . 

2. Negative and affirmative questions beginning with are 
and aren' t. 

3 # Interrogative questions beginning with what — are . 

Unit IV - Lesson 3 

1. Personal Pronouns + Be 

2. Questions with what + Be 

3. Telling Time: What time is it? It is . It's 



Unit V Lesson 4 

1. Present Progressive 

2. What + (Verb + (pronoun or noun ) doing? 
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Unit VI - Lesson 5 

1. Poisitive and negative statements with Are, there and 
Is there ? 

2. How much / many noun + be + there...? 

3 . Prepositions in, on, at 

Unit VII - Lesson 6 ( Have and Have to ) 

1. Have and have t o in affirmative statements and questions 

2. Short answers using do and does and their negative counter 
parts 

Unit VIII - Lesson 7 (part I) (Simple verb forms in present) 

1. Affirmative and negative statements using the simple 
present form of verbs. 

Unit IX - Lesson 7 (Part II) 

1. Simple verb forms in present tense 

2 . do and does 

Unit X - Lesson 8 (Possessive Pronouns and Independent Possessive 
Pronoun ) 

1. Statements using the possessive adjectives and possessive 
pronouns „ 

2. Personal nouns in the genitive case 

3. Use of interrogative whose to introduce questions 

o 

Unit XI - Lesson 9 (The Future Tense) 
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Unit XII - Lesson 10 

1. Review of lessons 1 to 9 

2 . Review of does , do - ing , — s_ 

Unit XIII - Lesson 11 (simple past form of the verb Be) 

1. Simple past of the verb to be ( was , were ) 

Unit XIV - Lesson 12 (Simple verb forms other than Be in the 
past tense) 

1. Did, didn : t 

Unit XV - Lesson 13 ( Interrogatives) 

1„ who, where, when, why 

2. Irregular verbs in the pest tense 
Unit XVI - Lesson 14 (Mass and Count nouns) 

1. how much and how many 4- a lot (of) -('less* 

2 „ some - any 

3. few - little 

Unit XVII - Lesson 15 (The Past Progressive Tense) 

1. past form of be + ing form of the verb 

Unit XVIII - Lesson 16 (Comparative and Superlative Adjectives) 
Unit XIX - Lesson 17 (Modals) 

1. can, could, may, might, ought to, should 
2- Time expressions 

Unit XX - Lesson 18 (Pre and Post nominal modifiers) 
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Unit XXI - Lesson 19 - The Present Perfect Tense 

1. have, has 

2 . Irregular past principles 

Unit XXII - Lessor- 20 - Review of all lessons 1 to 19 
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PUERTO RICAN FORUM, INC. 

BASIC OCCUPATIONAL LANGUAGE TRAINING 

TRAINING SESSION BREAKDOWN 

Unit # Duration; 2 hours 

I. Review - 10 minutes 

Oral review of previous lesson's work, using wide va- 
riety of language exercises. 

II. Programmed text - 10 minutes 

The entire group continues to work in the hook as the 
instructor goes around to each one. The instructor 
checks each student’s progress in the workbook indi- 
vidually, and records the number of exercises covered. 
Trainee s ask questions on specific points that caused 
some difficulty. 

III. Introduction of new structure - 30 minutes 

Visual aids of realistic job situations motivate the 
trainees and set the objective of the structure les- 
son, modeled, practiced and reinforced chorally and 
individually. New vocabulary is gradually introduced. 

IV. Language Laboratory I - 10 minutes 

Trainees practice the structures and vocabulary pre- 
viously introduced by repeating and answering special- 
ly created tape recordings „ The instructor monitors each 
student individually and stresses correct pronunciation 
and structures . 

V. Coffee Break - lo minutes 

Workers are encouraged to relax and practice conversa- 
tional English with each other and the instructor, also 
to speak to the instructor privately about any matter. 
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Training Session Breakdr\‘rn 



VI. Reading •- 30 minutes 

Specifically work oriented passages which include 
the vocabulary and structures of the lesson. 

VII. Writing - 10 minutes 

The workers reinforce their oral command of the 
structures and vocabulary practiced by visual 
representation in writing exercises, generally 
based on the previous reading exercise-. 

VIII. Language Laboratory II - 10 minutes 

Final reinforcement of the lesson's work is a re- 
view of the same tape recording used in Language 
Laboratory I - 
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BASIC OCCUPATIONAL LANGUAGE TRAINING 



BOLT 

Second Level 
Supervision Sheet 



Name of Trainee: 

Name cf Supervisor: 

Date of Training: From _ 

Interval (Training to follow up) 



j 

I 

’} 





Retrospective Pre-training Ratings 

I. How would you rate his job related English language use before 



training? 

Very poor poor 

2. How would you rate his non- job related English language use before 



fair 



good 



very good 



training : 
Very poor 



__ poor 



fair 



good 



very good 



Pest - training Ratings 

3* How would you rate his job related. English language use after 
training? 



Very poor 



poor 



fair 



good 



very good 



4. How would you ratu his non -Job r e la te d English language use afte* 
training? 



Very poor 



poor 



fair 



good 



very good 



5. Has his job performance been 



(a) The same as before training. 

(b) A little better than before training# 

(c) Much better than before training. 

6. Are his relations with his co*-x- 7 orkers 

(a) The same 

(b) A little better 

(c) Much better 
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Second Level Supervision 
Sheet (cont.) 



7. Based on your creteria for promotion, how promotable is he now- 

(a) Same as before 

(b) A little better 

(c) Much better 

3. As a group, what would you say have been the specific changes, rf 
any, that have happened in their job situation. 



9. What were the effects, if, any, of the BOLT Training on attitudes 
morale , and job satisfaction. 
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BASIC OCCUPATIONAL LANGUAGE TRAINING 



BOLT 

Supervisor Rating Sheet 



Name of Trainee; 

Student Number: 

Group Number : 

Date of Rating: 

Dates of Training: From to 

Interval (Training to follow-upj 

Retrospective Pre-training Ratings 

1. How would you rate his job-related English language 
use before training? 

Very poor poor fair good very good 

2 . How would you rate his non-job related English language 
before training? 

Very poor poor fair good very good 

Job Criteria 

3. What characteristics contribute to a worker's effectiveness? 



4. On this job what characteristics contribute to a worker's 
promotability (capacity to work at a higher level)? 
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Supervisor Rating Sheet (Cont.) 



5. On this job how important is language use in a worker’s 
effectiveness and promotability r 



Very little 

very important 
Post training Rates 
6 . 



little 



some 



important 



7. 



How would you rate his job-related English language use 
after training? 



Very poor poor 



fair 



good 



very good 



How would you rate his non- job-related English language, 
use after training? 



Very poor 



poor 



fair 



good 



very good 



8. Has his job performance been: 



a. Same as before training 

b. A little better than before training 

c. Much better than before training 

9. Are his relations with his co-workers: 

a. The same 

b. A little better 

c . Much better 

10- Based on your criteria for promotion, how promotable 
is he now? 

a. Same as before 

b. A little mere promotable 

c. Much more promotable 



11. What specific changes, if any, have happened in his 
job situation? 
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Supervisor Rating Sheet (Cont.) 



12. What were the effects, if any, fo the BOLT Training 
on attitudes, morale or job satisfaction? 





STUDENT RATINGS 



Information - follow up sheet 



I * BOLT Ratings 

Very Ver V 







Poor 


Poor 

I 


Fair 


Good 


Good 


(1) 


Evaluation of Purpose 
(Introduction and Orien- 
tation) 












(2) 


Course Materials 
(Books, tapes, etc.) 








{ 

I 


1 


(3) 


Physical setting 
(Bus) 










j 

1 


(4) 


Equipment and methods 
earphones , group descuss ion 
homework, etc. 


i 










(5) 


Instructors skill 










i 


(S) 


Instructors manners 












(7) 


Attitude of fellow Students 












✓"S 

CO 


Your personal attitude 












(9) 


Helpfulness of course in 

language uo grading 

(give examples if possible) 










l 


(10) 


Helpfulness of course on 

job effectiveness 

(give examples if possible) 




I 









II Information: 

(1) Effects on job (including job situation changes). 



(2) Effects beyond the job (homey family,, etc*). 
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Student Ratings (cont . ) 



(3) Attitude and self -concept effects. 



(4) Job perspectives (promotability , transrerability , mobility, 
job satisfaction and morale) 



SJ 
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MONTEFIORE HOSPITAL AND MEDICAL CENT! 
II! East 210 St. , Bronx* N.Y. 10467 

EVALUATION OF THE FIRST 



BASIC OCCUPATIONAL LANGUAG E TRAINING PROGRAM 

D escription: On October 16, 1968 the Puerto Rican Forum in 

cooperation with Mon tel lore Hospital and Medical 
Center began a program of training in Basic 
Occupational Language Skills for ten of the 
hospital’s employees- The language course, built 
around special medical terms and occupational 
vocabulary used at the Hospital, was designed 
to improve the opportunities and efficiency of 
employees who nets handicapped by poor English 
abilities. The program ran four days a week with 
two hour classes for a twelve-week period. Classes 
were held in a mobile language classroom outfitted 
with the latest in electronic tape and teaching 
equipment* It was staffed by a licensed instructor 
under the coordination of the Training Office. 

T.ie ten students were graduated on January 3, 1969. 

What follows is an evaluation of their achievements 
and performance as seen by trie Puerto Rican Forum, 
their instructor, their supervisors* and the training 
office . 

Time- The Puerto Rican Forum invested 1440 man-hours 

™~™ of classroom time without direct cost for the hospital. 

Approximately half the total man-hours were on a release 
time basis and half on the employee’s own time. 

Examination Res ulfcs '-Accord ing to the results of 
extensive testing based upon the University of 
Michigan profiency norms the students showed sig** 
nif leant upward achievement. The students were tested 
prior to the begining of the program, midway, and at 
the conclusion of the program. Prior to the program, 
the te*>t scores for all ten students ranged below the 
score uf 69 which proficiency norms indicates inability 
to undertake any skills training in an environment 
where English language is the medium of instruction. 

The group average was 49./ out of a possible 100, the 
latter meaning complete proficiency : n the English 
language at the level needed to succesfully complete 
a university course of instruction. 

By the half way mark in the BOLT Program the 
percentile average had risen to 61-3%, a markets in- 
crese although not sufficient to be congruent with 
the goals of the program. One of the students did 
score a grade of 73 in the mid- term. By the termination 
of the trilling program the class average had 
risen to 73**3%.' a 48% improvement in aural compre- 
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honsion was accompanied by a grade of 8Z-<> lot one 01 
the students. It should be noted that the attainment ot 
a proficiency score between 65 and /9 was consire^ 
sufficient for undertaking part time academic =• tudr^s 
in university. Scores of 80 percentile or aoove were 
considered sufficient to compete in any acacemt^ 
endeavor with native born Americans of the same intelligent 

A further check on the students' progress was provided 
bv scores in language structure and construction or 
sentences. There was a 28% improvement in test scores 
on this scale between the beginning and uhe end of the 
program. 

significantly improved their ability to compiehe 
to speak English. 

i ori . m-nce all the comments of the supervisors 

Supervisors evaluation. . Since experts from 

would be too numerous, what lcitouS aie 

an evaluation meeting held by the Training Office 

with three of the students' supervisors. 

Mr. R. Nameth of the Engineering Departme 
said that there were "certain little things whic. i 
indicated progress on the part of his employees 
<-o be more interested in the program and tnerefore 
i° the^iobs. He praised the effort and declared that the 
Language barrier had prevented many of his employees uom 
moving ahead: "1 have had to turn down a man for aiwu^ 
mechanic’s job because he couldn t speak Engl. i • 
excellent though, according to his references. 

Nemath also expressed a desire to see opan bh 

speaking employees cycleds through a permanen 
language laboratory. 11 

Mr. R. Luciano of General Services felt that his 
employees "have gained definately more comprehension 
confidence, and vocabulary. Vazquez (one of the BOLT 
students) is now interested in moving up. Ie - 

that of the other Spanish speaking employees m 1S 

seme 50 had expressed an interest and could 
nan such a program. Mr. Luciano aaid that he could supply 

ten ‘employees at any given time for the program. > 

ten employ better because they were proud 

of'golnft to 'school, hs a matter of fact their attendance 

also improved." 
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Mr* I. Stern, laundry executive said that "the 
BOLT program amices it easier for us to communicate 
with the employees . 1 would like to see the people 
who didnTt participate in the first one participate 
in a second." 

Student Evaluation: In interviews conducted approximately one month 

after the conclusion of the program, theTraining Office 
found all the students very enthusiastic about the BOLT 
Program and expressing the desires to attend more 
training programs to increase their opportunities for 
advancement in the health and allied fields. 

Lu 2 Verde jo , one of the BOLT graduates who worked in the 
laundry remarked, "....the program helped me understand instruction, 
especially at work." "I would like more English classes . "she 
added <■ 

" I loved the BOLT program, 11 Amparo Calderon, 
another laundry worker said. "Everyone was so nice 
now people can understand what I am saying to them." 

She decared that she had applied for the High School 
equivalency program run by the Training Office* 

(Due to lack of space, she is scheduled to enter 
the summer class.) 

When we talk to Marcella Aguirre, also a laundry worker, 

she was enthusiastic discussing the change that had taken > 

in her life since she began the BOLT program. " Very 

interesting for Spanish speaking people" she said of the 

program adding that communication in the lingue franca 

was very important a. far as attaining a good job with 

opportunities for advancement. "I am going to school now 

to improve my typing," she announced as we left. Miss Aguirre's mam 

hiridr .uce was in typing English with any speed although her typing 

in Spanish was of unusual quality. The Training Office has 

arranged for her to be considered by the employment 

office for a job as a clerk typist once she has improved her 

typing speed. 

Jorge Price, a BOLT student, now gives orders in rapid 
English in the storeroom where he works- Mr. Price 
achieved considerable facility in the English language 
upon graduation from the BOLT program and was rated as 
being, able to begin an academic course of study based on 
his English ab ill ties .When asked for his opinion on the 
program he said, "It was-ery good." "If we had more time we 
would have done even better." He added that previously .... 

I had been afraid to speak, now I try and am. able to speak tar 
better ID an ever could have without BOLT." Mr. Price sard tb^c 

"Monteficre has d me a lot for me by heir ~ 7 ^ e improve my 
English." 
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Training Office Eval uation : It is the conclusion of the Training Orfice staff 

that the HOLT program was a highly successful activity yrnich 
resulted in significant benefits for the Hospital and the indi- 
vidual students. These benefits may be summarized follower 

1 * The employees have improved t heir abilities to ge v tp rm 

their jobs - Tn the judgement of the students the 
supervisors and the Training Office ail oi the 
students are better able to perforin their jobs than 
they were before the program- The test aceres sub- 
stanciate this judgment. 

2 - The employees have become more capable of_ functio ning, 

as fu 1 1 members of an Engl ish - speaking^ sociaty « The 
general improvement of the students ability to speak 
and read the English language has made them more able 
to deal with the predominantly English-speaking society 
This can be seen not only in the test scores but also 
in their more self-confident attitude. 
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3- The employees 1 morals and general a 1 1 _itude .toward the. 
HospTtal and thei r jobs has been improved , While 
there has been no specific measurement of pre- and 
post-program attitude change, the records of interview we 
with the students seem to indicate a genei'a- improve- 
ment in morals and job attitude- This also seems to be 
the general observation of the supervisors- Each of 
the students has at one time or another gone out of 
the way to thank the staff of the Training Program for 
the opportunity to participate in the program, 

4. The e mployees have been motivated by the program Jto 
to , seak further training and educa tion » Of the 10 
students in the BOLT program, 8 have asked the staff 
of the Training Office about other training programs 
both within and outside of the Hospital. Six of the 
students applied for rhe High School Equivalency program. 
One of the most frequent comments made by the students 
before and after the program was that their success 
in the language program had convinced then that they could 
learn now things and there was little to fear from 
education - 

5- The p rogra m improved the more. ,, s and r f titude of frfi 

^th err than ^ those enrolled in the progra m. The s mple 
existance of the program stimulated several score of 
inquirias to the Training Office about training 
activities and created a sense of interest and exitament. 
amor g many Spanish-speaking employee** . Several of the 
supervisors remarked that the £ act that some employees 
were enrolled in the program encouraged others to develop 
a more favorable attitude toward the Hospital and tne 
hope that they too might benefit from future programs. 
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Training Office Evaluation (Continued); 

No specific figures can be determined, of course, but we 
believe it: fair to assume that the existance of the 
program lowered turnovar among low-level Span ish-soeakin 
employees „ 



E d wa r d W * Kna p pma n 
Training Coordinator 
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